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WHAT IS CLAIMED IS: 



1 LA method for producing a results list for a search query, the method comprising: 

2 producing a first results list of entries from a search algorithm, the first results list 

3 corresponding to a term in the search query, the first results list being ordered according 

4 to relevance rankings; 

5 modifying a feature of the first results lists by an editor, the modification being made 

6 according to an editorial rule; 

7 determining a reliability score for the editor, the reliability score being based upon the 

8 modification made the editor; 

9 combining the modification made by the editor in a combined search index, the 

I o combined modification being included in the combined search index according to the 

I I determined reliability of the editor; and 

12 using the combined search index to produce a second results list which corresponds to 

1 3 the term in the search query. 

1 2. The method of claim 1 wherein producing a first results list includes producing a first 

2 results list that corresponds to at least one search term. 

1 3. The method of claim 1 wherein modifying a feature according to an editorial rule 

2 includes modifying any feature of the first results list. 

1 4. The method of claim 1 wherein modifying a feature according to an editorial rule 

2 includes modifying an allowed changeable feature, the allowed changeable feature being 

3 one or more of relevance ranking, entry addition, entry deletion and document summary, 

1 5. The method of claim 3 wherein modifying a feature includes modifying a feature 

2 within a pre-defined range or percentage. 

1 6. The method of claim 4 wherein modifying an allowed changeable feature comprises 

2 modifying a feature within a pre-defined range or percentage. 

1 7. The method of claim 1 wherein determining a reliability score further comprises: 
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2 comparing a ranking change for an entry by a first editor to a median ranking change 

3 for the entry by a second editor. 

1 8. The method of claim 1 wherein determining a reliability score further comprises: 

2 comparing a summary change for an entry to a previous summary contained in the 

3 first results list. 

1 9. The method of claim 1 wherein determining a reliability score further comprises: 

2 determining a difference in a number or a percentage of click-throughs which result 

3 from the editor modification. 

I 10. The method of claim 1 wherein combining the modification made by the editor 
^ 2 further comprises: 

S 3 multiplying the reliability score by the feature modification. 

||| 1 11. The method of claim 1 wherein using the combined results to produce a second 

X 2 results list includes using the combined search index by a search engine. 

L 1 12. The method of claim 1 wherein said method is performed at least twice. 

m ^ 1 3 . A method for producing a results list for a search query, the method comprising: 
P 2 producing a first results list of entries from a search algorithm, the first results list 

3 corresponding to a term in a first search query, the first results list being ordered 

4 according to relevance rankings; 

5 modifying a feature of the first results lists by an editor, the modification being made 

6 according to an editorial rule; 

7 determining a reliability score for the editor, the reliability score being based upon the 

8 modification made the editor; 

9 combining the modification made by the editor in a combined search index, the 
10 combined modification being included in the combined search index according to the 

I I determined reliability of the editor; 



14 



Attorney's Docket: 10984-533001 /L-255 



12 detecting a difference between the feature contained in the first results list and the 

1 3 corresponding modified feature contained in the combined search index; and 

14 determining a rule that corresponds to the detected difference or similarity. 

1 14. The method of claim 13 further comprises: 

2 producing a second results list from the search algorithm, the second results list 

3 corresponding to the term in the first search query; 

4 modifying the second results lists by applying the rule to a feature contained in the 

5 second results list. 

1 15. The method of claim 14 wherein detecting a difference further comprises: 

2 detecting a change to a relevance ranking feature. 

1 16. The method of claim 14 wherein detecting a difference further comprises: 

2 detecting an added feature. 

1 17. The method of claim 14 wherein detecting a difference further comprises: 

2 detecting a deleted feature. 

1 18. The method of claim 14 wherein detecting a difference further comprises: 

2 detecting a change to a document summary feature. 

1 1 9. A computer program product residing on a computer readable medium having a 

2 plurality of instructions stored thereon which, when executed by the processor, cause that 

3 processor to: 

4 produce a first results list of entries from a search algorithm, the first resultst list 

5 corresponding to a term in a search query, the first results list being ordered according to 

6 relevance rankings; 

7 modify a feature of the first lists according to an editorial rule; 

8 determine a reliability score for the editorial modification, the reliability score being 

9 based upon the editorial modification; 
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10 combine the editorial modification in a combined search index, the combined 

1 1 modification being includes in the combined search index according to the reliability 

12 score of the editor; and 

13 use the combined search index to produce a second results list which corresponds to 

1 4 the term in the search query. 

1 20. The computer program product of claim 19 wherein the instructions causing a 

2 computer to modify a feature of the first lists according to an editorial rule further 

3 comprise instructions causing a computer to: 

4 modify a feature according to an editorial rule. 

1 21 . The computer program product of claim 20 wherein the instruction causing a 

2 computer to modify a feature according to an editorial rule further comprise instructions 

3 causing a computer to: 

4 modify an allowed changeable feature, the allowed changeable feature being one or 

5 more of relevance ranking, entry addition, entry deletion and document summary. 

1 22. The computer program product of claim 20 wherein the instructions causing a 

2 computer to determine a reliability score for the editorial modification further comprise 

3 instructions causing a computer to: 

4 compare a ranking change for an entry by a first editor to a median ranking change 

5 for the entry by a second editor. 
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